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ABSTRACT 

A collaborative research anu development project 
resulted in three research/intervention projects (R/lPs) using an 
inquiry-based process for student teachers, cooperating teachers, and 
teacher education faculty. A cross-site analysis identified relative 
differences among the thre^ projects, variables associated with the 
projects, and interactions among the variables. The impact of the 
R/lPs upon classroom teaching behaviors and continued use of research 
in teacher education was described. There was little variation across 
the three projects; however, there were considerable differences in 
the goals, initial planning, and method of intervention. The 
relationship between each teacher education program and its 
cooperating school district was especially important. There were no 
clear results regarding change in classroom teaching behaviors. 
However, the perspectives of student and cooperating teachers toward 
the value of research became increasingly positive across all three 
sites. Achievement of the project goal of a continuing and expanding 
network among teacher education programs and local education agencies 
appeared promising. (Author/JD) 
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ABSTRACT 



This report describes a conaborative research and development 
project Implemented by Far West Laboratory for Educational Researcfi 
and Development In conjunction with The University of Utah, The 
University of Nevada at Reno, and Mills College in Oakland, 
California. The main purpose of this project was to stimulate and 
support collaborative development of preservlce teacher education 
strategies, based on the assumption that there Is a relatively 
substantial body of recent research findings on effective Instruc- 
tion that could be rapidly and usefully Incorporated Into classroom 
practi ce. 

The overall project resulted In three research/Intervention 
projects (R/IPs) using an Inquiry-based process for student teach- 
ers, cooperating teachers, and teacher education faculty. A cross- 
site analysis Identifies relative differences among the three 
research/Intervention projects, variables associated with the dif- 
ferent projects, and the Interactions among the variables. The 
report further describes the Impact of the R/IPs upon classroom 
teaching behaviors and the continued use of research In teacher 
education programs. 

In general, there was little variation across the three 
research/Intervention projects. However, there were considerable 
differences In the goals. Initial planning, and the method of 
Intervention. The relationship between each teacher education 
program and Its cooperating school district was especially 
Important. 

There were no clear results regarding change In classroom 
teaching behaviors. However, the perspectives of student and co- 
operating teachers toward the value of research became Increasingly 
positive across all three sites. Achievement of tne project goal 
of a continuing and expanding network amonc, teacher education pro- 
grams and local education agencies appears promising as well. 
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CHAPTER ONE 
INTRODUCTION 

Over the past year and a half, a series of reports decrying 
t.ie sorry state of education In America have been highly 
publicized. A central concern of all these s'^-udies has been the 
poor quality of our elementary and secondary teaching force. The 
President's Commission on Excellence In Education, for example, 
reports In A Nation at Risk: The Imperative for Educational Reform 
that "iiot; enough of the academically able students are being 
attracted to teaching; that teacher preparation programs need sub- 
stantial Improvement; that the professional working life of 
teachers Is on the whole unacceptable; and that a serious shortage 
of teachers exists In key fields." (1983) 

While these reports iiave been welcomed by educators for shed- 
ding much needed light on the myriad problems of the teaching 
profession, their findings hardly come as a surprise to profes- 
sionals who have been grappling with the difficulties of bettering 
our system of schools for years. Since 1978, Far West Laboratory 
for Educational Research and Development (FWLERD) has been Involved 
In a number of efforts improving the quality of classroom teachers 
by facilitating teachers* incorporation of the research on effec- 
tive teaching practices into their regular classroom activities. 
Continuing this tradition, in December of 19b2, Far West initiated 
a program directed at improving the preservice educational ex- 
perience of classroom teachers. 
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Background of the Project 

The Applying Research In Teacher Education (ARTE) program 
focuses on the development of techniques for applying research on 
effective Instruction and effective schools to education personnel 
development during the teacher education period. As with Far West 
Laboratory's earlier efforts aimed at Improving teaching, the pro- 
gram was premised on the assumption that there is a relatively 
substantial body of recent research findings on effective instruc- 
tion that could be rapidly and usefully Incorporated into classroom 
practice. Moi trover, the ARTE program was based on the assumption 
that teacher education programs could incorporate research as an 
inquiry-based process for student teachers, cooperating teachers, 
and teacher education faculty. 

One facet of the larger ARTE program is the Research Utiliza- 
tion in Elementary Teacher Education (RUETEJ project. The RUETE 
project includes two activities: the development and implementa- 
tion of three research/ intervention plans and the formation of 
ongoing Teacher Education Academies. A description and analysis of 
the completed research/ intervention projects are the focus of this 
report. Figure 1 presents a schematic chronological outline of the 
RUETE project. 

In Phase I of the RUETE project. Far West Laboratory selected 
and convened a Regional Teacher Education Team (RTET), consisting 
cf the Far West Laboratory Project Director and experienced teacher 
educators from the following institutions in the Laboratory's 
region: 
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Figure 1 
RUETE Chronological Outline 
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0 University of Utah, Salt Lake City (Amy Drlscol), Regional 
Research Fellow), In collaboration with the Salt Lake 
City School District; 
0 University of Nevada, Reno (Kenneth Johns, Regional 

Research Fellow}, In collaboration with the Washoe County 
School District; and 
0 Mills College, Oakland, Callrornla (Richard Ponzio, 

Regional Research Fellow), In collaboration with the Vallejo 
City Unified School District. 
The team collaboratively examined the consistent patterns of 
research findings about effective Instruction and successful ele- 
mentary schools. The RTET members then undertook several struc- 
tured activities to practice observation strategies for the appli- 
cation of this research to their own instructional programs for 
preservice teachers. The structured activities enabled each member 
of the team to generate a document synthesizing their experiences 
and to tailor those to their own teacher education programs. 

In the second step of the project, the Research Fellows wrote 
Situational Analyses of their home institutions* teacher education 
prograrc These analyses described in detail the Research Fellow's 
university, the cooperating school district, and the community in 
terms of the teacher education program, preservice teacher charac- 
teristics, state certification requirements, and the recruitment 
and hiring criteria for local education work forces. 

The Situational Analyses provided the Research Fellows with the 
necessary baseline data to develop plans for using the research on 
effective instruction at their individual sites. In collaboration 



with Far West Laboratory staff, the Research Fellows each created a 
research/intervention plan (R/IP) that Integrated relevant research 
findings and classroom Instructional analysis techniques Into his 
or her Institution's preservice teacher instructional program. 
Through the late summer ana early Fall of 1983, the Research 
Fellows implemented their training designs in an attempt to enhance 
the quality of teachers entering the local elementary school teach- 
ing force. 

During this same period, each Research Fellow began to develop 
plans for the creation of a Teacher Education Academy (TEA) at his 
or her own site. The Teacher Education Academies, which are being 
Implemented as part of Phase II of this project, will serve as a 
forum for addressing the concerns of teacher educators and local 
educational agency personnel and for furthering the Incorporation 
of research-based knowledge into the elementary teacher education 
process. 

Conceptual Framework 

This report limits itself to a cross-site analysis of the 
development ana Implementation of the three research/intervention 

ojects. Analysis of the research/intervention projects fits 
conceptually into four distinct stages. This framework Is 
presented schematically in Figure 2 and explicated below. 

Stage 1 

Far West Laboratory actions in carrying out this project 
constituted the first step in the entire process. Far West 
Laboratory chose the participating teacher educators, brought them 
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Figure 2 
RUETE Conceptual Framework 
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together In the RTET, structured and facilitated their meetings, 
selected the relevant research for examination by the team, and 
remained, throughout the project, the central organizing force. 
This intervention can be considered a constant In the process In 
that an the Research Fellows were provided the same technical 
Information and support. Since a central concern of the project 
was the successful application of research to teacher education 
programs, it Is Important to examine the effects of the collabora- 
tive strategy that Far We:,t Laboratory utilized. Our research 
question here Is: How effective was the collaborative model In 
applying research on effective teaching techniques to preservlce 
teacher education programs? 

Stage 2 

Brought together by Far West Laboratory and provided the same 
amount and quality of technical assistance, each Research Fellow 
developed and Implemented a different research/Intervention pro- 
ject. A central focus of this analysis Is a comparison of these 
projects. The research questions are: What variables are as- 
sociated with the development and Intervention of the three 
research/ Intervention projects? How do these variables Interact to 
Influence the research/Intervention projects? 

Stage 3 

The third key process relevant to this study Is the effect of 
the various strategies for applying research to teacher education 
programs on the behavior of teachers In the classroom. In that 
section of the paper, we examine the relative effectiveness of 
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the three strategies for changing teachers' behaviors. The research 
question here Is: What factors In the research intervention 
strategy can be associated with the varying outcomes In teacher 
behaviors? 

Stage 4 

Finally, we examine the effects of the Involvement of the 
three teacher education programs and the local school districts In 
this program on their continued cooperating relationship to train 
both preservlce and Inservlce teachers. Here our central research 
question Is: How has the Far West Laboratory Intervention changed 
the approaches that these teacher education programs and local 
school districts use to apply effective instruction research in 
teacher preparation? This stage of the conceptual framework is 
based on the continuing effort to establish and promote the Teacher 
Education Academies and will be reported on in another document. 
The ultimate success of the Far West Laboratory intervention 
depends on continued quality teacher education programs after Far 
West Laboratory is no longer involved. 

In the following sections of this report, we examine each of 
the first three stages outlined above and attempt to answer the 
associated research questions. 
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CHAPTER TWO 

THE METHOD OF INTERVENTION: COLLABORATIVE INQUIRY 

Over the past decade, research has identified a coherent body 
of knowledge concerning effective teaching practices (Brophy, 
1979). Unfortunately, mucn useful research never is applied at the 
classroom level (Huling, 1982; Griffin et ah, 1983). In response 
to the chronic underuti lization of research on effective instruc- 
tion by classroom teachers^ Far West Laboratory developed the 
interactive research and development on teaching (IR4DT) model 
(Tikunoff, Ward, & Griffin, 1979). Researchers at Far West Labo- 
ratory discovered that because much research is carried out in the 
lexicon and according to the agenda of professional researchers and 
their funding agencies, classroom teachers generally find it to be 
incomprehensible or irrelevant to their everyday tasks (Tikunoff & 
Mergendoller, 1583:2). As teachers generally are excluded from the 
research process, they are relegated to the role of consumers of 
research which may not be either comprehensible to them or relevant 
to their work. Tikunoff & Mergendoller (1983) have argued that the 
exclusion of teachers from the research process accounts for the 
underutilization of research findings in classroom instruction. 

The interactive research and development on teaching (IR&DT) 
model was developed to correct this problem by incorporating 
teachers into the research process along with professional 
researchers ^ind individuals responsible for staff development. In 
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the application of the IR&DT model, researchers, teachers, and 
staff developers work as equal members of a team to develop a 
research project and, concurrent! v, a r^^ff training program in a 
local school district. 

Tikunofv and Mergendoller (1983) found positive results of 
collaborative research efforts in two different sites. Besides 
producing tangible and relevant research findings, the 
participants Developed a more critical, reflective eye toward their 
own work and institutions, developed collaborative and discussion 
skills, and grew professionally. In addition, teachers, research- 
ers, and staff developers came to understand and respect one 
anothers* work. 1 1 another study carried out at the Texas Tech 
University Teacher Corps, teachers who participated in a collabora- 
tive research project became more comfortable with the research 
Intervention and more creative in their application of the Innova- 
tion than teachers in a control group {Huling, 1982). Additional- 
ly, teachers in this study who took part in the collaborative 
process noted that they would be much more willing to use research 
after their experience than they had been before hand. Finally, in 
another study which examined the contextual variables affecting the 
success of the IRiDT models, the researchers found a common outcome 
of all participants across sites was a "powerful, unmatched op- 
portunity for growth" (Lieberman & Noto, 1983:18). 

Given these experiences wi"^ collaborative modes of inquiry in 
overcoming the obstacles to the application of research to 
teachers* classroom activities. Far West Lab decided to attempt to 
adapt the collaborative process in Its ARTE: RUETE project. 
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The IR&DT model seemed appropriate for our work with teacher 
education faculty for the very same reasons that it was first 
develoj^ed for work with classroom teachers. Research has shown 
that teacher educators, like classroom teachers, do not apply re- 
search to their own teaching In any systematic way. Carter (1981: 
54-5b) found that the knowledge base of teacher educators Is ex- 
tremely diffuse, that tw^.re .s little agreement regarding either a 
central core of Information or the procedures for teaching It. In 
fact, most teacher educators learned to teach either by "doing It" 
or by "modeling others" (Carter, 1981:48). Few faculty actually 
used relevant research to inform their own methods. In another 
study, Fleman-Nemser and Ball (1984) argue that the lack of the use 
of research by classroom teachers can be explained by misleading 
and confusing views about the proper use of formal knowledge 
propagated by teacher educators. 

Our own findings at the three Institutions of higher education 
(IHEs) In this study. Mills College, the University of Utah at Salt 
Lake, and the University of Nevada at Reno, showed a similar lack 
of systematic and effective use of the research on effective In- 
struction. In Utah, a survey of teacher education faculty found 
little knowledge of relevant research. At the Nevada site, a 
number of the faculty were teaching certain techniques Identified 
as effective In the literature, but there was no systematic use of 
the research In curriculum development. At Mills, faculty members 
In the elementary education program were using research on child 
development but little on effective teaching strategies. Thus, In 
all of our three sites, the teacher education faculties were not 
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accustomed to applying research systematically In their teacher 
education programs* The IR&Dl model Is especially suited to this 
type of situation as It does not simply Impose research findings on 
the participants, Dut rather allows them to determine the type of 
research relevant to their own programs* 

Moreover, a primary goal of the entire ARTE: RUETE project Is 
the ongoing application of research findings In both the teacher 
education programs ana the local educational agencies* Inservlce 
training. To this end, the final outcome of our activities will be 
the establishment of Teacher Education Academies (TEAs) at each of 
the three sites. Although the three academies will differ somewhat 
depending on local needs, all three will be collaborative processes 
between the university and the local education agency; each will be 
made up of teacher educaiori^ and local district personnel respon- 
sible for recruiting and inducting new elementary school teachers* 
We expect that teachers from the district and student-teachers 
also will be involved in the collaborative process. In essence, 
the teacher education academies will be ongoing collaborative pro- 
grams at the local level. Moreover, after the 1984-85 school year, 
these academies will be functioning independently of Far West 
Laboratory. It is Imperative, then, that the regional research 
fellows, who will be establishing and heading up these academies, 
have developed the skills of collaborative inquiry before they 
establish the TEAs. The IH4DT model, as much research has demon- 
strated, provides just these skills. 

The interactive research and development on teaching model 
provided Far West Laboratory with a catalyst for encouraging 
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professionals who are not systematically using research In their 
work to dc so. Moreover, a by-product of the IR&OT model, the 
development of collaborative inquiry skills, was a central goal of 
the research intervention. The IR&DT model, then, appeared ap- 
propriate for our work with the Research Fellows. 

A central assumption underlying our choice of the collabora- 
tive process for the application of research to teacher education 
programs was that the regional research fellows would choose rele- 
vant research and apply it to the p^^^grams at their home institu- 
tions. In order to assist them in doing so. Far West Laboratory 
took the responsibility of acting as a catalyst for the research 
fellows by initiating the process, providing the fellows with 
relevant information, and professional and collegial support. At 
the same time, our review of the literature on the collaborative 
process made it clear that in adapting the IRADT model to this 
situation, it would be imperative that the research on effective 
teaching strategies at each of the institutions of higher education 
take place concurrently with attempts to apply the research in the 
student teachers* classrooms to ensure its applicability to the 
teacher training programs, that the research fellows and Far West 
Laboratory staff work together as a team in which all members had 
an equal voice, and that the research intervention process respect 
the integrity of each of the fellow's home teacher education pro- 
gram so as not to force irrelevant research on the program 
(Tikunoff & Mergendoller, 1983:8-10). 

Far West Laboratory provided the catalyst for the application 
of research on effective teaching to the teacher training programs 



erJc 



13 

21 



J 

of the three institutions by bringing the research fellows together 
in the Regional Teacher Education Team. Researchers at Far West 
conceived the idea of establishing a formal mechanism which incor- 
porated the IR&DT model for applying research to teacher education 
programs. It was Far West Laboratory that provided the Research 
Fellows with both the organizational structure and the monetary 
support to pursue their research interests in the field of teacher 
education. All three Research Fellows agreed that they never would 
have undertaken a research project the scope of this one without 
the intervention of Far West. Moreover, the Research Fellows* 
affiliation with a prestigious national research laboratory pro- 
vided their research projects a certiin amount of credibility at 
both their home Institutions and with the local school districts. 
Finally, participation in the Far West-sponsored project held out 
the potential for professional growth and advancement for each of 
the participating Research Fellows. As one Research Fellow put it, 
"an important criterion for my participation was the opportunity 
for promotion in my department". In essence, the ARTE: RUETE 
project, as an organized and on-going vehicle for research, pro- 
vided the necessary catalyst to move teacher educators from three 
separate institutions to begin to apply the research on effective 
teaching to their own programs. 

The second important feature of the collaborative process is 
the provision of relevant information to the participants. 
Throughout the twenty months of this project. Far West Laboratory 
has been the major source of information for the Fellows. In the 
first two meetings of the RTET, Far West Laboratory introduced the 
Research Fellows to the relevant literature on the IR&DT model and 
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to the research on effective teaching practices. The Fellows were 
providea with a series of scholarly articles and experts from 
various fields briefed the Fellows on the intricacies of the 
research findings. Additionally, the Laboratory trained the 
Fellows In appropriate research techniques including development 
and use of instruments to monitor teacher activities in the class- 
room. Finally, throughout the development and the implementation 
of their individual research projects. Far Hest Lab has continued 
to provide the Fellows with relevant technical support (for 
example, the training of research assistants in observation tech- 
niques) as well a5 additional literature on the specific research 
the Fellows chose to utilize in their projects. 

While the original catalyst and structure for the Regional 
Teacher Education Team (RTET) came from Far West Laboratory, the col- 
laborative process required that subsequent activities be developed 
by the team as a whole. Thus, once the background on the collab- 
orative process and the research on effective teaching were 
presented, the research fellows began to play an equal role with 
Far West Laboratory staff in the further development of RTET 
activities. From the survey of research on effective teaching 
strategies, the Research Fellows chose two specific strategies. 
Academic Learning Time (ALT) and Active Teaching Behaviors (ATB) to 
study In-depth. Together with Far West Laboratory staff, the 
Fellows adapted specific instruments to measure the amount of ALT 
ana ATB taking place in a particular class. 

Furthermore, from the very first meeting of the RTET, the 
Fellows were asked to share relevant Information concerning their 
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home sites. At that initial meeting* the Fellows developed an 
outline for their situational analyses. In-depth reports on the 
existing content and process of the teacher education programs at 
the three sites. While the Individual Fellows collected the data 
for and wrote the situational analyses on their own institution, 
these analyses went through extensive review by the other Research 
Fellows, other faculty at their home institution, a representative 
from the local school district, and Far West Laboratory staff. 
Before these analyses were complete, they had gone through several 
complete drafts. 

There were a number of purposes to this extensive process. 
First, the situational analyses provided the Fellows with the 
baseline data from which to begin to develop their research inter- 
vention plans. Second, the process of analyzing their own institu- 
tions allowed the Fellows to begin a critical examination, in 
cooperation with their fellow faculty members and local school 
personnel, of their present teacher education programs, their 
cooperating school districts, and the historical relationship 
l^etween the two* Third, through reading and discussion of each 
other's analyses, the Fellows became acquainted with one another's 
institutional settings. Fourth, the formal introduction of each 
Fellow's research context assured that the particulars of that 
context would be understood and respected by other members of Uie 
team as they worked toward developing research intervention stra- 
tet^les. Finally, and perhaps most Importantly, this process of 
reviewing, criticizing, and rewriting marked the beginning of the 
formal collaborative process which was to continue throughout the 
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duration of the project. 

This same process took place as the Research Fellows began to 
develop their research intervention plans after the second RTET 
meeting. Based on the review of the research on effective teaching 
which took place in the first two meetings and on the baseline data 
specific to their home institutions which they developed in their 
situational analyses, and using instruments developed collabora- 
tively by the RTET, the Research Fellows returned to their home 
institutions and began to establish specific strategies for ap- 
plying the research in their teacher education programs. These 
plans were reviewed by all other members of the- team, criticized, 
and discussed in a sub?-^quent meeting. The Fellows then rewrote 
the research intervention plans and resubmitted them to one another 
for further review* Similarly, as the Fellows began to implement 
their resear:h plans, difficulties and promising strategies were 
communicated among members of the team, technical support was 
provided where needed, and the Fellows revised their plans when 
input from other members appeared relevant. 

Thus, while the original catalyst and structure for the 
activities of the RTET was provided by Far West Laboratory, the 
actual development and implementation of the research intervention 
plans resulted from a collaborative process among team members 
providing mutual support for one another as they worked as equals 
toward a common goal. 
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CHAPTER THREE 

DESCRIPTION AND CROSS-SITE ANALYSIS CF THE 
RESEARCH/INTERVENTION PROJECTS 

As noted earlier in this report, all three Research Fellows 
underwent the same experiences as members of the Regional Teacher 
Education Team (RTET), receiving virtually the same training and 
technical assistance from the Far West Laboratory staff. Even so 
the Research Fellows developed significantly different plans for 
applying the research on effective teaching strategies in their 
respective institutions* teacher education programs (Uriscoll, 
1984; Johns & Gee, 1984; Ponzio, 1984). In this chapter, we 
describe each of the three research/intervention projects, outline 
the variations among them, and analyze the factors that Influenced 
those variations. 

Utah 

Setting 

The University of Utah, Salt Lake City has the largest 
publicly funded teacher education program in the state of Utah. 
The elementary and early childhood program has 260 students. The 
majority of students are over 25 years of age and are married. 
There are a 15 full-time faculty members in the elementary/early 
childhood education program. The typical faculty member is over 45 
years of age and holds an undergraduate degree in education. 

Preliminary interviews with student teachers and faculty at 
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Utah revealed little or no knowledge of research on effective 
Instruction. Neither faculty nor students were able to Identity 
major researchers In the field of effective Instruction research. 
Furthermore, the teacher education faculty reported limited use of 
effective instruction research In their course work. Interest- 
ingly, cooperating teachers from the cooperating school district in 
this study. Salt Lake City, did possess a basic knowledge of the 
research on effective instruction. 

The student teaching practicum at the University of Utah has 
been organized through an ongoing collaborative relationship with 
seven local elementary schools in three local school districts: 
Granite, Jordan, and Salt Lake City. These seven schools are known 
as Professional Development Centers (PDCs). They were chosen based 
on the qualify of the schools, representation of socioeconomic 
status and cultural diversity of their student populations, loca- 
tion, and teachers* and principals* commitment to working with 
student teachers. All student teaching occurs in these schools. 

Goals 

The general goal of the research/intervention plan at the Utah 
site was to alter the teacher education program to include the ap- 
plication of the research on effective teaching strategies. More 
specifically, the plan was devised to: a) engage prospective teach- 
ers in a systematic examination of their practices and efforts to im- 
prove them; b) to engage teacher educators in small scale but persis- 
tent inquiry into their own practices and their contributions to 
teacher quality; and c) to foster fruitful collaboration between the 
local school district and universit> in the preparation of teachers. 

19 
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Sample Selection 

The sample for this study consisted of 12 preservlce teachers 
In the elementary education certification program at the Univer- 
sity of Utah, Salt Lake City, four teacher education faculty from 
the same institution, and four experienced cooperating teachers 
from the elementary schools In the Salt Lake School District. All 
members of the sample volunteered to take part In the study. 

Methodology 

The IZ preservlce teachers were randomly assigned to three 
groups: Treatment Ast, those who were to participate In a collabo- 
rative planning session and the preservlce Instruction; Treatment 
Bst, those who were to receive just the preservlce Instruction; 
and. Treatment Cst, the control group, which would neither take 
part In the collaborative session, nor In the preservlce Instruc- 
t1 on. 

In July of 1983, the four student teachers In treatment group 
Ast, the four teacher education faculty, and the four cooperating 
teachers took part In a four day collaborative meeting. The agenda 
for that collaborative session consisted of a review of major 
topics in the research on effective instruction, selection of one 
topic for a research development focus, and the development of a 
preservlce instruction plan. 

The participants collaboratively selected the research find- 
ings on active teaching behaviors (Good, 1979, 1983) as most 
salient for preservlce teacher education. Following this decision, 
participants developed a preservlce instruction plan consisting of 
a review of the research on active teaching behaviors (ATB), 
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extensive observation of videotapes for Identification and recording 
of ATB, assessment of lesson plans for ATB, and role playing active 
teaching behaviors with peers. Additionally, ATB observation forms 
were to be used In self-observation, observations of peers and 
cooperating teachers, and by university supervisors of student 
teachers. 

In September of 1983, the preservlce Instruction plan 
developed by the team of teacher education faculty, student teach- 
ers, and cooperating teachers was Implemented as part of the "Early 
Experience" session designed for fall quarter student teachers. 
The "Early Experience" session Is a nonmandatory four-week, student 
pre-teachlng program consisting of half-day attendance In class- 
rooms, observations, mini lessons, and seminars with teacher educa-- 
tlon faculty. The preservlce Instruction on active teaching be- 
haviors consisted of four sessions, two hours each. In the follow-- 
Ing format: 

Session 1 (first week) - Introduction to the research on ATB; 
observation via videotapes. 

Session 2 (second week) - Extensive observation via videotapes; 
discussion of ATB. 

Session 3 (third week) - Review of lesson plans for Inclusion 
of ATB; observation of videotapes; discussion of Missouri 
Mathematics Effectiveness Project. 

Session 4 (fourth week) - Role playing of lesson plans to 
demonstrate and critique use of ATB; summary discussion and 
evaluation. 

Hypotheses 

Two specific null hypotheses were posed: 
1) Student teachers who participate in the collaborative 
development of preservlce training using the research findings on 
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effective Instruction will not differ significantly In their ability 
to demonstrate the teaching behaviors Identified in the preservlce 
training from those students teachers who do not participate. 

2) Student teachers who participate In the preservlce 
training using the research findings on effective instruction will 
not differ significantly in their ability to demonstrate the 
teaching behaviors identified in the preservlce training from those 
students who do not participate In the preservlce training. 

Data Collection 

The three sample groups of student teachers, Ast, Bst, and 
Cst, were observed during mathematics instruction for three one- 
hour sessions. Observations recorded the incidence of active 
teaching behaviors using an instrument developed by the Regional 
Teacher Education Team at Far West Laboratory. This Instrument 
contains 20 teacher behavior items in four teaching categories: 
introduction, instruction, closure, and management. Recordings 
were made every 60 seconds, and included notation of incidence, 
additional behaviors observed, and a narrative description for each 
session. Observations and recordings were done by two trained 
observers who were research assistants. Training was done with the 
ATB observation Instrument. Training proceeded until observers 
reached 90% inter-rater agreement. Finally, nine months after the 
initial collaborative session, student and cooperating teachers 
were interviewed by the Research Fellow in order to measure the 
long term affects of their participation in the intervention. 
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Data Analysis 

The four teacher behavior categories of the ATB Instrument 
In the frequency of Individual behavior Items were used. A chl 
square test with three degrees of freedom was used to analyse the 
statistical significance of the differences among groups. 

Mi lls College 

Setting 

The teacher education program at Mills differs significantly 
from the programs at both Utah and Nevada in two Important ways. 
First, the teacher education department of Mills is primarily a 
graduate level program; on the undergraduate level. Mills is a 
women's liberal arts college. Second, the Mills program is very 
small. There are on.y 13 credential candidates in the whole pro- 
gram. The students are between 25 and 30 years of age; approxi- 
mately one third are married. There are three faculty members in 
the elementary education program. 

Preliminary interviews of student and cooperating teachers 
revealed some familiarity with the concepts found in the research 
on effective instruction. None of the teachers, however, had worked 
with the research firsthand. None of the faculty members at Mills 
had read extensively about any of the topics in the research on 
effective instruction, and only two had applied the literature in 
any form to their assessment of student teachers' performance. 
Moreover, Mills faculty did not require student teachers to apply 
effective instruction techniques in their teaching assignments. 

The elementary schools traditionally used in the credential 
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program Include schools In the Oakland, Piedmont, and Vallejo 
public school systems. The Vallejo schools were recently added to 
the group of cooperating schools because of the development of 
reciprocal professional work with Mills College. Moreover, the 
Vallejo school system has one of the most outstanding professional 
development programs for teachers In the state of California. 

The number of schools participating In the teacher education 
program Is limited In order to place several students at one site, 
where they can share their perceptions and assist one another In 
videotaping. As a result of concentrating teachers in a few 
schools, a cadre of cooperarting teachers who have shared in 
evaluating and developing the Mills program is available for 
student teachers. 

Goals 

The r'^search intervention plan at Mills College in Oakland, 
California, was designed to study the effects of the application of 
research on effective teaching in the preparation of prospective 
elementary school teachers. More specifically, project leaders 
hoped to improve the teaching of student teachers in Mills 
College's preservice training program, and to enhance the communi- 
cation between student teachers and their cooperating teachers. 

Initial Planning 

The Mills Research Fellow took a somewhat different approach 
to the development of a research intervention plan. Here, the 
Research Fellow first established an advisory group. Initially, 
this group consisted of the Mills College Fellow, a colleague on 
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the Hills faculty, a visiting scholar at Mills, the project 
director from Far West Lab, and the Staff Development Coordinator 
from the Vallejo City Unified School District. Throughout the 
development and Implementation of the research strategy, the Fellow 
turned to members of this advisory group for assistance. 

In consultation with the Vallejo Staff Coordinator, the Mills 
Fellow Identified a single school as a site for the Intervention. 
The Fellow, then, hired two research assistants, one the Instruc- 
tional Assistant from the participating school, the other a highly 
regardeo teacher in Vallejo who has since begun a doctoral program. 
With these two adc^itional participants, the visiting scholar at 
Mills and the Research Fellow functioned as a research team. 

In early September, the research team came together with 
members of the advisory group. The Project Director from Far West 
Laboratory introduced and the team reviewed the literature or, 
academic learning time (ALT) (Fisher et al., 1978, Fisher et al., 
1980) and on active teaching behaviors (ATB) (Good, 1983). Members 
of the research tearp were trained in the use of ALT and ATB 
observation instruments to an inter-rater agreement of .90. Col- 
laboratively, the research team reviewed the course syllabi in the 
Mills teacher education program and developed a plan for introduc- 
ing these concepts to student and cooperating teachers. 

Sample Selection 

The sample of student teachers consisted of five preservice 
elementary credential candidates at Mills. The team also selected 
five cooperating teachers from one of the Vallejo schools, all of 
whom came from the preferred pool of teachers consistently used by 
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the Mills teacher education program. All 10 participants were 
volunteers. Additionally, the Mills* faculty and the two research 
assistants remained Involved In the Intervention. 

Methodology 

The five student teachers and five cooperating teachers were 
paired together, one student teacher being assigned to each 
cooperating teacher. Ten days after the student placement, and 
prior to any introduction to academic learning time (ALT) or active 
teaching behaviors (ATB), the research assistants observed both 
student and cooperating teachers to collect baseline data on both 
ATB and ALT In the classrooms. Subsequent to the baseline data 
collection, cooperating and student teachers took part In a three 
day training on academic learning time and active teaching be- 
haviors. The training was presented by the collaborative research 
team, Including the Research Fellow, the two research assistants, 
and one faculty member from Mills. 

During the training, the student teachers and coopera-^-Ing 
teachers were presented with the research on effective Instruction 
related to ATB and ALT. The teachers viewed videotapes, observed 
classrooms, and took part In coding sessions. ATB and ALT observa- 
tion Instruments which had been developed at Far West Laboratory 
were used to train the teachers In the use of systematic observa- 
tion techniques. The training provided ample practice and Instruc- 
tion to jevelop a consistently high level of Inter-rater agreement. 

In addition to the three day training, the semester-long 
student teaching experience was used as an Important element of the 
observation process. As an Integral part of this experience, the 
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student and cooperating teachers were asked to assess each other 
using the observation Instruments Introduced In the Initial train- 
ing- They were also requested to schedule weekly conferences to 
provide each other feedback, using the observation forms as a basis 
for discussion. The cooperating teachers provided the Research 
Fellow with summaries of these weekly meetings. 

hypotheses 

Three specific hypotheses were posed: 

1) Student teacher and cooperating teachers who are trained 
to assess ALT and ATB will Increase their Instructional effective- 
ness In math. 

2) Student teachers and cooperating teachers who are trained 
to assess ALT and ATB will Increase the ratio of ALT In their math 
lessons as measured two months after the training session. 

3) Increased knowledge of research related to ALT and ATB 
will change the supervision of student teachers by their cooperat- 
ing teachers through: specificity of feedback; Increased reci- 
procity of feedback between the cooperating teacher and student 
teacher; and, the rlevelopment of a common lexicon related to the 
feedback. 

Data Collection 

Both quantitative and qualitative methods were used to collect 
data on the research Intervention plan. Utilizing the ATB and ALT 
instruments developed at Far West Laboratory, the research assis- 
tants observed the cooperating and student teachers both before and 
after the intervention. In addition, cooperating and student 
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teachers wrote paragraphs before and after the Intervention con- 
cerning th.'ir knowledge of ATS and ALT. Finally, after the conclu- 
sion of the project, the student and cooperating teachers, the 
Research Fellow, and one of the research ass1st<ints, were Inter- 
viewed by a visiting scholar on the Mills' faculty. 

Data Analysis 

The pre- and post-Intervention frequencies of both ATB and 
ALT, collected by the research assistants using observation Instru- 
ments, were compared fo^ each student and cooperating teacher. A 
test of significance was utilized to examine the actual differences 
In Individual behaviors overtime. The research Fellow supplemented 
this quantitative data with an analysis of the teachers' pre- and 
post-intervention writings and of the interview data collected by 
the visiting scholar* 

Nevada 

Setting 

The University of Nevada, Reno is the sole four-year institu- 
tion of higher education in northern Nevada. The College of Educa- 
tion has approximately 900 students; of these, approximately 30 
each year student teach. The typical elementary student teacher is 
female, single, and 26 years old. There are five full-time faculty 
members in the elementary school program. The great majority of 
these have more than 15 years experience and will be retiring 
within the next two years. 

Preliminary interviews of the student teachers at Nevada 
showed most students had not encountered effective instruction 
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topics in their course work and student teaching. A majority of 
Interviewed faculty Indicated that they did Introduce the topic of 
active teaching behaviors in their classes* These faculty were 
not, however, tamniar with most of the topics of effective instruc- 
tion research* 

The relationship between the University of Nevada's teacher 
education program and the local educational agency, the Washoe 
County School District, is overseen by the Professional Advisory 
Board. Membership on the board Includes school administrators, 
public school classroom teachers, and College of Education faculty* 
While the Washoe School District encompasses a number of rural 
schools, over 90% of the student teachers from the University of 
Nevada are placed in the urban center of Reno. The College of 
Education has made every effort to avoid the repeated utilization 
of a select few cooperating teachers. In the Reno schools, the 
student teacher is generally considered to be an asset to the 
school and the cooperating teacher. Therefore, the regular assign- 
ment of student teachers to the same classrooms is avoided in order 
to balance harmony among teachers within the district* 

Goals 

The Nevada research intervention plan, like that of both Utah 
and Mills, sought to apply research on effective teaching method- 
ology to the site's teacher training program in order to improve 
its student teachers' performance in the classroom. Unlike the 
other two cases, however, the Research Fellow in Nevada focused on 
the development of an efficient method of effecting changes in 
teacher behavior. Specifically, the Nevada Fellow explored whether 
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It was necessary to provide student and cooperating teachers with 
extensive training In the use of effecting teaching strategies In 
order to effect the use of such strategies. 

Sample 

In this case, all 28 cooperating teachers In the school dis- 
trict who were to supervise student teachers In their classroom In 
the Fall 1983 semester were asked to participate In the research 
activity. All 28 teachers agreed to do so. The 28 student teach- 
ers were also Included In the project as a part of their regular 
student teaching experience. As In both Utah and Mills, the topic 
of mathematics was chosen because of the relatively clear-cut 
Instructional behaviors, the generally limited number of concepts 
Introduced at one time, and because previous research on active 
teaching behaviors had been most frequently conducted on mathe- 
matics Instruction. 

Methodology and Data Collection 

beginning In early September, each cooperating teacher was 
observed on two days while teaching mathematics. Immediately 
following those observations, each student teacher was observed 
one time while teaching mathematics. The active teaching behaviors 
Instrument developed at Far West Laboratory was used for these 
observations. After each observation, a summary statement de- 
scribing the general procedures employed In the classroom was 
recorded and then transcribed. These procedures provided both a 
quantitative and qualitative record of the classroom. 

The Research Fellow rank ordered all the cooperating teachers 
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according to their level of exhibited active teaching behaviors. 
These teachers were divided into two categories, those demonstrat- 
ing high ATb, and those demonstrating low ATB. The Research Fellow 
then assigned all cooperating teachers to one of four separate 
treatment groups. The first group consisted of one-half the 
cooperating teachers who had exhibited high levels of ATB and who 
were to be provided with the ATB instrument which had been used to 
observe their teaching. The second group included the other half 
of the high ATB teachers; this group, however, was not going to 
receive the observation instrument. Similarly, the cooperating 
teachers with low ATB were broken up into two groups, one which was 
to receive the observation Instrument, and one which was not. The 
28 student teachers had previously been randomly assigned to a 
cooperating teacher In one of the four groups without regard for 
the level of teachers* ATB. 

Beginning in November 1983, the Research Fellow provldea the 
ATB observation Instrument to the two groups of cooperating 
teachers (one high in ATB, one low) and asked them to use It In 
observing the student teacher during the latter's mathematics In- 
struction. The cooperating teacher also was asked to share the 
observation sheet with the student teacher and to provide the 
student teacher with a set of definitions and examples of the 
behaviors to be observed. There was no formal training for the 
cooperating teachers in how to use the Instrument. 

In late November, the two control groups of student teachers 
(those who were with cooperating teachers who did not have the 
observation Instrument) were observed one time to assess their use 
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of active teaching behaviors. Immediately afterward, those student 
teachers who had been introduced to the observation instrument were 
observed one time tor post-intervention data. 

All observations of student and cooperating teachers were 
conducted by the same research assistant. This observer had been 
trained in the use of the Far West Laboratory ATB observation 
instrument with videotapes and actual classroom situations. Ob- 
server agreement was ,89. The trained observer was not informed 
which of the student teaching sites were designated high or low 
ATB. 

Research Questions 

Three specific research questions were addressed: 

1) Given the association of a cooperating teacher strong in 
the use of active teaching behaviors (ATB) with a student untrained 
in ATB: Will the student internalize and manifest those behaviors 
without the intervention of an ATB observation Instrument which 
focuses on active teaching behaviors? 

2) Similarly, will the use of an observation instrument yield 
a higher level of the use of ATB in the student teacher who is 
associated with the cooperating teacher who is high in ATB? 

3) Conversely, given the association of a cooperating teacher 
low in the use of active teaching behaviors with a student teacher 
untrained in AfB: Will the use of the ATB observation instrument 
cause the student teacher to display higher levels of ATB than a 
student teacher in a similar pairing, but not using the ATB 
observation instrument? 
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Data Analysis 

As a result of Incomplete observations and loss of student 
teachers, the final sample size consisted of 21 pairs of student 
and cooperating teachers. Differences In frequencies of active 
teaching behaviors pre- and post-intervention were analyzed for 
each of the four treatment groups. Variation in differences among 
the four groups were then compared. Each data cell was submitted 
to a Chi square test of significance with three degrees of freedom. 

Variations Across the Projects 

An overview of the three R/IPs shows that all three sought to 
improve the effectiveness of teachers through the applicat on of the 
research on effective teaching to their tearher education programs. 
All three chose to work with the research on active teaching be- 
haviors. All three developed quasi -experirrental Intervention plans 
which separated their samples into a variety of treatment groups. 
At all the sites, some degree of control was established either by 
the use of pre-intervention observation or by the use of control 
groups. Research assistants and the three Research Fellows col- 
lected both qualitative and quantitative data on the use of active 
teaching behaviors, using the same ATB instrument developed at Far 
West Laboratory. Finally, all three Research Fellows measured the 
effect of their particular Intervention by comparing frequencies of 
active teaching behaviors either pre- and post-intervention or 
between control and treatment groups. 

Despite their similarities, however, the three research/ 
intervention projects represented significantly different approaches 
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to applying the same research. These differences are most marked In 
the goals of the three projects, the methods by which the Interven- 
tion plans were developed, and the ways In which the projects were 
imolemented. 

The purpose of this section is to examine the specific differ- 
ences among the three research/intervention projects. The charac- 
teristics of each project as described in the previous sections are 
summarized in Table 1 to aid in the following discussion. 

Goals 

Although the general goal of the three R/IPs was the same, the 
projects differed significantly in their more specific operation- 
al ized goals. Utah's was the most ambitious of the three plans. 
The team at Utah sought to engage both student teachers and teacher 
education faculty in a systematic examination of their own prac- 
tices, in an effort to Improve them. Moreover, the plan hoped to 
foster a more collaborative relationship between the local school 
district and the teacher education program. The Mills project 
sought to Improve the communication between student and cooperating 
teacher with the hope that, in combination with the use of effective 
teaching strategies, such communication would further improve 
student teacher performance. The goal of the Nevada plan was less 
far reaching than either of the other two. Here the plan focused on 
examining the utility of a simple intervention strategy in effecting 
changes in student teacher behaviors. 

Method 

The method by which the research/Intervention plans were 
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Table 1 

Variation in Research/Intervention Projects 





SITES 




Utah 


Mills 


Neoada 


SAMPLE %m 








Student Teachers 


IZ 


S 


21 


Cooperating Teachers 


12 


5 


21 


Teacher Education Faculty 


4 


Z 


1 


DATA COLLECTION TRAINING 


July 1983 


SepteRi>er 1983 


September 1983 




One 4-day collab- 
orative westing of 
student teachers, 
cooperating teach- 
trs, teacher educa- 
tion faculty • and 
Far tfest Laboratory 

SUff 


4 days for 
teacher education 
faculty and re- 
search esslstants, 
by Far Kest 
Laboratory staff 

September 1983 


Z days for research 
assistant and 
teacher education 
faculty by Far West 
Laboratory staff 

On going 




August 1983 

4 two-hour Early 
Experience sessions 
for student teachers 
by teacher education 
faculty 


3 days for student 
teachers and coop- 
erating teachers by 
teacher education 
faculty and re- 
search assistants 

On going 


Cooperating 
teachers use of 
observation Instru- 
eent 




OrtAh^r 1983 

Z days for re- 
search assistants 
by Far West 
Laboratory staff 


Student teacher/ 
cooperating teacher 
feedback with 
teacher education 
facul ty 




OBSERVATIONS 


October 1983 


Septentber 1983 


September 1983 




4 student teachers 
Croup A (Collabora- 
tive Session) 

4 student teachers 
Croup ( (Early 


5 student teachers 
(pre) 

5 cooperating 
teachers (pre) 


28 cooperating 
teachers 

21 student teachers 
November 1983 




Experience) 


Oecetter 1983 






4 student teachers 
Group C (Control) 


5 student tcacKers 

(post) 


21 student teachers 




Deceiber 1983 


5 cooperating 






4 student teachers 
Group A (Collabora- 
'cUt Session) 


teachers (post) 






4 student teachers 
Group 6 (Early 
Experience) 








4 student teachers 
Group C (Control) 






SUBJECT/CLASS OBSERVED 


Kath. direct 
Instruction 


Hath, direct 
Instruction 


Math, direct 
Instructi on 
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developed at the three sites can be differentiated by their 
relative extensi veness, the number of Interested parties involved, 
and the degree of collaboration among the responsible parties. 

Again, the Utah plan stands at one end of the continuum. 
Here, the Research Fellow Invited four student teachers, three 
members of the teacher education faculty, and four cooperating 
teachers to take part In the planning of the research intervention. 
The project paid for University credit for the cooperating teach- 
ers. This team collaboratively examined the research on effective 
teaching, selected a specific topic most relevant to their work, 
active teaching behaviors, -and developed an extensive preservice 
instruction plan. The research intervention, then, was the result 
of a collaborative effort on the part of representatives of all 
groups which were to take part in the Intervention, 

At Mills College, the initial planning was similar in as much 
as the research strategy was developed with the input of represen- 
tatives from the relevant parties. The advisory group Included a 
member of the Mills College faculty, a visiting scholar at Mills, 
the project director from Far West Laboratory, and the Vallejo 
Staff Development Coordinator from the participating school dis- 
trict, Vallejo City Unified. The research team consisted of the 
Research Fellow, the visiting scholar at Mills, the Vallejo Staff 
Development Coordinator, and two research assistants, both certifi- 
cated employees of the school district. This smaller team, then, 
reviewed the literature on effective instruction and assisted the 
Research Fellow in developing a research intervention plan. The 
Mills and Utah teams differed, however, in both the degree of 
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collaboration and the composition of the teams. Through the first 
stages of the initial planning stage, the Mills Fellow made a 
number of Important decisions (the school site, the focus on ALT 
and ATB, for example) without the collaborative input of all mem- 
bers of the research team. Unce the team was established and 
working collaboratively, neither cooperating teachers nor student 
teachers took part in planning sessions. 

The development of the research/intervention plan at the 
Nevada site stands in stark contrast to the two others. Here, the 
Research Fellow basically developed the intervention on his own. 
While he did consult with both the superintendent and the staf"*' 
development officer in the local school district, he held sole 
responsibility for its development. No other faculty members, 
student teachers, cooperating teachers, or local district personnel 
played an active role in u'le creation of the intervention strategy. 

Implementati on 

The way in which the research on active teaching behaviors was 
introduced into the teacher education program at the three sites 
can be differentiated by the extensi veness of the intervention, its 
place in the preservice experience, who took part in the training, 
and the degree of control over the introduction. 

At the Utah site, the training took place during the voluntary 
four-week, pre-student teaching program. Eight student teachers 
took part in xhe preservice training. Four of these had been 
Involved in the collaborative team that designed the training 
sessions, and so were already familiar with the concepts of active 
teaching behaviors. The preservice training consisted of two-hour 
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sessions, one day a week, oyer the four-week period. The Research 
Fellow and her colleagues at University of Utah Introduced the 
student teachers to the literature on active teaching behaviors; 
the student teachers then observed videotapes of teachers using ATB 
methods and wrote lesson plans based In the ATB methodology. These 
plans were criticized, and then the student teachers "taught" one 
another using ATB. 

Five student teachers and their five cooperating teachers took 
part in the Mills preservlce training, the training took place 
over a three day period during the first month of the student 
teaching experience. In order to allow the cooperating teachers to 
attend the training, the project paid for substitute teachers for 
their classes. The Research Fellow, two faculty members from 
Mills, and the two research assistants presented the literature on 
active teaching behaviors. The student and cooperating teachers 
viewed videotapes, observed actual classes, and practiced coding 
using the active teaching benavlors Instrument designed at Far West 
Laboratory. 

Importantly, the Intervention at Mills continued throughout 
the student teaching semester. The cooperating teachers were asked 
to hold weekly meetings with the student teacher during which they 
were to provide one another with feedback on their use of ATB. 

The Nevada research/Intervention plan was designed to be much 
less extensive than either the Mills or Utah plans. In November of 
the fall semester, the Research Fellow visited the classes of the 
two treatment groups of cooperating teachers and provided them with 
the ATB observation 1ns*.rument. The Fellow requested that the 
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cooperating teachers use the Instrument to observe the student 
teachers. Furthermore, the cooperating teachers were asked to 
share the observation sheet with the student teacher and to provide 
both definitions and examples of the behaviors. There was, 
however, no formal training for the cooperating teachers In the use 
of the Instrument. 

Factors Influencing Variation Across Sites 

A central facet of the design of Far West Laboratory project 
was the provision of latitude to the Regional Research Fellows to 
develop intervention strategies relevant to their respective teacher 
education programs. As we noted in the previous section the result 
of this freedom was the creation of broadly different intervention 
plans in the three sites. While it may be inevitable that three 
different researchers frcni three separate institutions would develop 
differing plans even given the same information and technical sup- 
port, we believe it is informative to explore this variation across 
sites. As federal, state, and local educational agencies search for 
innovative ways to improve the education of tomorrow's teaching 
force, their policy decision should be informed by an understanding 
of the structural factors that influence attempts to apply research 
findings in teacher education programs. 

Clearly, the differences we found in the research intervention 
plans in Utah, Nevada, and Mills are a function of the specific 
goals established by the teams and individuals at those sites. We 
argue, however, that the variation in the manner in which the re- 
search plans were developed, in the specific goals of the interven- 
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tlons, and In the Interventions themselves Is a function of varia- 
tion In particular contextual factors. Specifically, we view the 
variation across the three sites along the following dimensions: 
the characteristics of the teacher education program; the character- 
istics of the cooperating local school district; the historic 
relationship between the teacher education program and the local 
school district; and the research fellows themselves. Figure 3 
schematically portrays the interaction among these various factors. 

Characteristics of the Teacher Education Program 

The existing degree of collaboration among teacher education 
faculty, the size of the program, and the existence of latitude in 
the program for the interjection of an innovative research project 
influenced both the development and the implementation of the 
research intervention plans. 

At the Mills site, the small number of faculty in the education 
department work as a team, coordinating activities and instruction 
in all program areas. Collaborative planning and evaluation are the 
key components of the Mills program design. The elementary and 
early childhood program at Utah is much larger, 15 full-time faculty 
versus three at Mills, and such regular coordination is not 
feasible. The newer faculty at Utah, however, have established an 
Informal network to support one another's professional efforts. The 
Research Fellow at the Utah site, herself a third year assistant 
professor, was able to turn to members of this group for support in 
her efforts to develop an intervention plan. In contrast, the 
Nevada Fellow noted that the faculty in his department work in 
isolation from one another. 
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Figure 3 

Factors Influencing Variation Across Sites 
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The effects of the tradition of Interaction among the teacher 
education faculty In the three sites had consequences for the 
research Intervention plan. At both Mills and Utah, the Research 
Fellows Invited other members of their departments to participate 
In both the planning and the Implementation of the Intervention 
strategies. At Mills, where the Interaction among the three 
faculty members In a small department Is regular and frequently 
Informal, the Research Fellow collaborated with his colleagues In a 
much less structured manner than was the case In Utah. At Nevada, 
the Research Fellow worked with a sole research assistant la 
teac^ier at a local community college). 

The teacher education programs at both Mills and Utah are 
structured In such a way as to provide faculty with sufficient 
latitude to Interject Innovative plans. At Utah, there Is a four- 
week "Early Experience" session prior to the beginning or regular 
classes during which preservice teachers attend half^-day classes, 
develop mini-lesson plans, observe classrooms, and take part in 
seminars headed by teacher education faculty. The Utah Research 
Fellow was able to utilize this less formally structured period to 
carry out a rather extensive four-day training period in active 
teaching behaviors for student teachers. 

While Mills College has no structured period analogous to the 
"Early Experience," it has eliminated traditional course schedules. 
The Mills program is organized to permit flexIblHty in the time 
students spend receiving formal instruction as their classroom 
observation and participation in the classroom gradually increase. 
This more flexible schedule allowed the Mills Fellow to conduct a 
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three-day training period early on In the stuoent teaching experience. 

The Nevada teacher education program, while continuing to 
develop Innovative course programs, maintains a traditional course 
program. Moreover, no organized perloa Is provided when student 
teachers and faculty come together outside of regular classes. The 
Nevada Fellow, then, had no "natural" or easily created period In 
which he could train students as part of the research innovation 
plan. As the Nevada Fellow noted, if such a structured period 
existea, his research strategy would have been more similar to 
Utah's and Mills. 

Characteristics of Local School District 

In all three sites, the research/intervention plan was 
implemented in cooperation with a local school district. The 
commitment of the district to the ongoing training of teachers, 
especially the extent to which this commitment is reflected in 
specific staff development programs affected the intervention 
strategies in all three cases. 

The Vallejo district, site of the Mills College intervention, 
has developed a strong staff training program over the past seven 
years, manifested in the establishment of a department of staff 
development. There is a Prc^essional Development Center (PDC) where 
Instructional teams, composed of teachers and administrators from a 
single school, come for assistance in developing better instruc- 
tional programs. After these teams return to their schools, the 
PDC's staff provides follow-up assistance. The Vallejo district 
also has worked with a number of colleges and universities besides 
Mills on improving their staff training program. Finally, in a 
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number of the Vallejo schools, teachers have formed support groups 
in which they provide one another feedback on the effectiveness of 
their teaching. 

The Salt Lake City Unified School District, site of the Utah 
plan, has also developed a number of organized, innovative programs 
for staff development. Among these innovations are: The Master 
Teacher program, a Teacher Support Center, a Peer Advisor Group (15 
experienced teachers serve as mentors to first year teachers), and 
a Teacher Remediation Team (colleagues provide assistance to teach- 
ers who are in "p'^o^'essional trouble"). In addition, there are a 
number of PDCs based in individual schools which serve as the loci 
of both preservice and inservice training in the district. 

The Washoe County School District, site of Nevada interven- 
tion, like the other two districts, traditionally has been commit- 
ted to a strong staff development program. The Washoe program is 
unlike Vallejo's and Salt Lake City's, however, in two fundamental 
ways. First, the district has not developed the series of 
organized structures like development centers and peer advisory 
groups. Second, whereas Salt Lake and Vallejo have worked col- 
laboratively with local teacher education programs in the develop- 
ment of their staff training programs, Washoe county has maintained 
a program with minimal university collaboration. 

These differences among the three districts are reflected in 
the three sites* intervention strategies. Both the Mills and Utah 
Research Fellows had formal training structures available to them in 
their school districts. In the Utah case, the Research Fellow used 
the PDCs as the sites of her intervention, as these are located in 
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Individual schools. The Mills Fellow worked with the head of the 
staff development department In choosing a school suitable to his 
Intervention strategy. The school which was selected was one In 
which the teachers had come together In Informal groups to critique 
one another's methods. Because of this manifest openness to con- 
structive criticism, the research/Intervention project In Vallejo 
Included frequent seslons between student and cooperating teachers 
in which they provided one another with feedback on their use of 
active teaching behaviors. Such meetings were not a part of either 
of the other two projects. In the Nevada case, the Washoe school 
district, committed as it was to improving Its teaching corps, 
welcomed the Research Fellow. There was, however, no organized 
structure into which to fit the research/intervention project. The 
resultant project was one in which communication flowed between tt.c 
Research Fellow and the cooperating teachers without the aid of an 
established structure. 

Relationship Between the Teacher Education Program and the 
Local School DistrTct 

The most important factor in explaining the variation among the 
development and Intervention of the three research/intervention 
projects is the traditional relationship between the teacher educa- 
tion program and the cooperating school district. While all three 
Research Fellows enjoyed excellent professional relationships with 
district staff responsible for the placement and training of student 
teachers, the formal relationships bet/een the teacher education 
programs and the school districts varied widely. 

In Utah, the school-based Professional Development Centers 
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had been developed through a collaborative effort between the 
school district and the university. In fact, the PDCs serve as bona 
fiae extensions of the university in the schools. The principals of 
the schools in which the PDC's are located serve as adjunct as- 
sistant professors in the university's teacher education program. 
Moreover, an explicit function of the rXs is to assist In the 
training of preservice teachers. All of the University of Utah's 
student teachers are placed in one of the PDCs (there are PDCs in 
other school districts as well). Generally, the same group of 
cooperating teachers and administrators work with the Utah teacher 
education program in the placement and training of student teachers 
overtime. 

The relationship between the Mills College teacher education 
program and the Vallejo school district is not as structured as that 
In the Utah case. In Vallejo, the PDC is based in the central 
district rather than in the schools. Still, the teacher education 
faculty at Mills has worked with the district staff development 
department in selecting a group of schools in which to place student 
teachers. Over time, this group of schools has stablized somewhat, 
providing the Mills program with a cadre of experienced teachers and 
administrators with whom to work year after year. 

The University of Nevada, Reno, does have a formalized rela- 
tionship with the Washoe school district through the Professional 
Advisory Board. The board, composed of school administrators, clas- 
sroom teachers, and College of Education faculty, maintains open 
lines of communication between the schools and the college. It also 
participates in a yearly recognition of outstanding student teachers 
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and cooperating teachers. Yet, while this formal advisory board 
exists to oversee the relationship between the teacher education 
program and the school district, the method of piecing student 
teachers In the district's schools has mitigated against the 
establishment of formal cooperation among a continuing corps of 
district teachers, administrators and college faculty. The college 
and the district have worked to distribute student teachers among as 
many schools as possible, and within those schools, among as many 
teachers as possible. The resulting relationship of thi.'i practice 
Is the exact opposite of that In Utah and Mills where specialized 
cadres of administrators and cooperating teachers have been 
developed over the years. In Nevada, from one semester to the next, 
the college faculty generally are dealing with different schools, 
different administrators, and different teachers. 

In attempting to Interject an Innovative research plan into the 
student teaching experience, the three Research Fellows were con- 
fronted with somewhat different c1 rc;<mstances. The Utah Fellow had 
a structure, collaborative preservice training effort already in 
place with the school district. She was able to convene a team of 
cooperating teachers in the middle of the summer to help in the 
development of the research plan, ^^oreover, she had a structured 
program In which to implement the project. The Mills fellow did not 
enjoy such a structured relationship. Yet, he had worked with 
district staff in selecting certain schools as the regular sites for 
student teacher placement. He was then able to bring the district's 
staff development director into the coHaborative development of his 
research stratrgy. At the same time, he had a regular cadre of 
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experienced cooperating teachers whom he could bring into the im- 
plementation of the plan. The Nevada Fellow was faced with a very 
different situation. He had neither a structured program nor a 
group of experienced cooperating teachers. The Nevada research 
strategy with its minimal Interaction between college faculty and 
cooperating teachers reflects this situation. 

Research Fellows 

The final set of explanatory factors we will examine are the 
characteristics of the Research Fellows themselves. A major conten- 
tion of this section of the study has been that the variance in 
contextual factors across the three sites accounts for uuch of the 
difference among the three research/intervention plans. We are not 
arguing, however, that differences among the three individuals who 
spearheaded the research efforts at the three site d'^i not effect 
some of the variatior: in those efforts. As one of the Fellows put 
it, "He are three different people and you could not expect that we 
would all go out and do the same things.'* 

The personality of the Research Fellows seems to have had some 
effect on the research strategy. The Nevada Fellow noted that he 
"tends to work alone, quietly, on a one-to-one basis." Both the 
Mills and Utah Fellows describe themselves as outgoing, social types 
who are more comfortable working with others. The effect of these 
personality types on the research plans is clear, both the hills and 
Utah Fellows involved a number of people, while the Nevada Fellow 
worked alone. 

All thrre of the Research Fellows enjoyed excellent relations 
with the administrators in their local school districts responsible 
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for student teachers. The Mills Research Fellow has authored a 
number of articles with the staff development officer from Vallejo. 
The Utah Research Fellow has worked closely with district personnel 
In the Professional Development Centers. The Nevada Research 
Fellow, as Director of Student Placement for the university, has 
been working with the Washoe school district for years and has 
developed a close working relationship with both the superintendent 
and the administrator In charge of preservlce placement. The rela- 
tionships of the three Research Fellows with their districts differ, 
however, regarding cooperating teachers and school site administra- 
tors. As we noted in the previous section, the Mills and Utah 
Research Fellows worked with the same cadre of teachers and adminis- 
trators and semester after semester, enabling them to develop a 
network of trusting personal relationships. Because the Nevada 
Research Fellow worked with different teachers and administrators 
each semester, he could not maintain similar relationships. The 
resulting ability of the Mills and Utah Fellows to involve cooperat- 
ing teachers in their research strateyies is the apparent conse- 
quence of these differing relationships. 

Another Important variable appears to be the opportunity for 
professional growth and advancement that participation in the pro- 
ject afforded the Research Fellows. Both the Utah and Mills Re- 
search Fellows are assistant professors, in the process of extending 
their professional portfolios toward tenure. Ihe Nevada Research 
Fellow already has tenure, although he viewed the project as an 
opportunity to be promoted to full professor. It appears as though 
the Mills and Utah Fellows had more need for research experience and 
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publications than the Nevada Research Fellow. Their larger stakes 
were reflected in both the extensi veness of their research/ 
intervention projects and in their attempts to apply the same research 
strategies in other sites. 

It is clear, then, that individual differences In personality, 
personal relations with relevant actors, and perceived opportunities 
in the project, all af,w*cted how the research/intervention projects 
differed. It is, however, just as clear that the contextual 
factors—the characteristics of the local school district, the 
characteristics of the teacher education program, and the relation- 
ship between the two—had a much greater impact on the development 
and implementation of the research/intervention plans than did the 
individual differences among the three Research Fellows. 
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CHAPTER FOUR 
OUTCOMES FOR TEACHING BEHAVIORS 

In this chapter we examine the effects of the various strate- 
gies for applying research In teacher education programs on the 
behavior ana attitudes of the participating teachers. We win 
consider two types of outcomes. First, we are Interested in the 
changes In teachers' use of active teaching behaviors as measured 
quantitatively by the ATB Instrument. Second, we win look at the 
potential long-term effects of the three Interventions by examining 
changes In student and cooperating teachers' perceptions of their 
classroom behaviors. 

Change In Active Teaching Behaviors 

In all three research strategies, quantitative data were 
collected on the participating teachers* use of active teaching 
behaviors. Observations were made by trained research assistants 
using the ATB Instrument developed at Far West Laboratory. (A copy 
of the ATB manual Is attached as an Appendix to this report.) 

In the Mills case, five cooperating teachers and five student 
teachers were observed at the beginning of the Fall 1983 semester. 
Subsequently, all 10 teachers went through a three-day training 
session In the use of active teaching behaviors. All 10 were then 
observed again later In the semester to gauge the effect of the 
intervention. 
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In the Utah case, tour cooperating and four student teachers 
were assigned to treatment group A which took part In the collabora- 
tive planning session In mid-July and in the four-aay preservlce 
training in September 1983. Another set of four cooperating and 
four student teachers were placed in group B which only took part in 
the preservice training. A final set of four cooperating and four 
student teachers functioned as a control, receiving neither the 
preservice training nor the opportunity to participate in the col- 
Idborative session. In November of 1983, all 12 student teachers 
were observed to assess their use of active teaching behaviors. The 
three groups of student teachers were compared in order to measure 
the relative effect of participation in the collaborative process 
and the preservice training. 

At Nevada, 28 cooperating teachers were observed by the 
trained research assistant and placed into one of two groups, those 
high in the use of active teaching behaviors and those low. Each 
of these two cohorts were broken up into two smaller groups. One 
of the high-ATB groups and one of the low-ATB groups received an 
ATB observation instrument to share with their student teachers. 
The 28 student teachers were randomly assigned to one of the four 
groups. Pre- and post-intervention data on active teaching be- 
haviors were collected for all student teachers. 

The results in all three cases are fairly ambiguous. The data 
from the Mills intervention are presented in Table 2. Active teach- 
ing behaviors for student and cooperating teachers are reported both 
pre- and post-intervention in four categories, introduction, in- 
struction, closure, and management. In the introduction category. 




Table 2 



Mills College 

Comparison of Frequencies within Categories of 
Active Teaching Behaviors (ATB) 



Student Teachers 



PRE 



POST < 



PRE 



POST 



Categories 


1 Introduction 


Instruction 


Closure 


Management 


Frequency 


9 


144 


2 


26 


X of Behavior 

within 
categories 


39.1 


60.8 


50.0 


55.3 


Frequency 


14 


93 


2 


21 


t of Behavior 

within 
categories 


60.9 


39.2 


50.0 


44.7 


ting Teachers 


Categories 


Introduction 


Instruction 


Closure 


Management 


Frequency 


22 


158 


7 


36 


I of Behavior 

within 
categories 


55.0 


58.3 


63.6 


50.0 


Frequency 


18 


113 


4 


36 


t of Behavior 

within 
categories 


45.0 


41.7 


36.4 


50.0 
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student teachers increased their use of active teaching behaviors; 
cooperating teachers reduced theirs. In the instructional category, 
both student and cooperating teacher active teaching behaviors de- 
creased after the preservice intervention. In the closure category, 
student teacher behaviors remained stable while cooperating teach- 
ers' behaviors decreased. In the management category, student 
teachers* behaviors decreased, while those of cooperating teachers 
remained stable. The data do not clearly point to quantitatively 
measured effects of the research intervention. 

Data from the Utah site student teachers are presented in Table 
In two categories, instruction and management, the control group 
had the highest frequency of active teaching behaviors; the group 
which took part in both the collaborative process and the preservice 
training had (treatment A) the lowest incidence of those behaviors. 
In the introduction category, the results were the reverse. Treat- 
ment group A had the highest level of active teaching behaviors and 
the control demonstrated the lowest incidence* In the closure 
category, the data are mixed. Treatment A and the control group 
have the same incidence; treatment B (those participating only in 
the preservice training) showed the least active teaching behaviors. 
Again, the results do not point to any clear conclusions. 

The data from the Nevada site (Table 4) suggest some tentative 
conclusions. In treatment Group IV, which did not receive any 
introduction to the ATB instrument and in which the student teach- 
ers were paired with cooperating teachers low in ATB, there was a 
decrease of active teaching behaviors in all categories. In Group 
II, those without the instrument but paired with cooperating 
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Table 3 

University of Utah 

Comparison of Frequencies within Categories of 
Active Teaching Behaviors (ATB) 
for Student Teachers 



TREATMENT A 



TREATMENT 8 



COKTROL 



Categories 


Introduction 


Instruction 


Closure 


Management 


Frequency 


49 


247 


17 


63 


t of Behavior 

within 
categories 


46.2 


29.7 


38.6 


27.0 


Frequency 


42 


271 


10 


76 


t of Behavior 

within 
categories 


39.6 


32.6 


22.7 


32.6 


Frequency 


15 


314 


17 


94 


X of Behavior 

within 
categories 


14.2 


37.7 


38.6 


40.3 
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Table 4 

University of Nevada 

Comparison of Frequencies within Categories of 
Active Teaching Behaviors (ATB) for Student Teachers 



GROUP I: HIGH ATB/INSTRUMENT 





. i Categories 


Introduction 


Instruction 


Closure 


Kanaqement 


PRE 


Frequency 


8 


434 


0 


82 




X of Behavior 












within categories 


36.4 


53.4 


0.0 


7.9 




[ , 

1 Frequency 


14 


378 


6 


117 


POST 










1 


X of Beh>v1or 












1 within categories 


63.6 


46.6 


100.0 


5fi.fi 


GROUP II: 


HIGH ATB/NON-INSTRL 


IMENT 




1 Categories 


Introduction 


Instruction 


Closure 


Management 




f 

1 Frequency 


7 


464 


1 


97 


PRE 1 


X of Behavior 












within categories 


53.8 


54.8 


100.0 


39.1 


POST 


r 

Frequency 


6 


383 


0 


151 




I of Behavior 












within categories 


46.2 


45.2 


0.0 


60.9 



GROUP III: LOW ATB/lNSTRUMENT 





1 

1 Categories 


1 

Introduction 


Instruction 


Closure 


Management 


PRE 


I Frequency 


4 


330 


1 


35 




X of Behavior 
I within categories 


20.0 


49.4 


100.0 


3i.3 


POST 


Frequency 

S of Behavior 
within categories 


16 

80.0 


338 
50.4 


0 

0.0 


77 

6fi.fi 


GROUP IV: 


LOW ATB/NON-INSTRUME»T 




^ Categories 


Introduction 


Instruction 


Closure 


1 

Management 


PRE 


Frequency 

X of Behavior 
within categories 


19 

79.2 


408 
53.3 


5 

100.0 


36 

52.9 


POST 1 


Frequency 


5 


357 


0 


32 




X of Behavior 
within categories 


20.8 


46.7 


0.0 


47.1 
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teachers high In ATB, there was a decrease In all but one of the 
categories, management. Conversely, the use of active teaching 
behaviors by student teachers who were Introduced to the Instrument 
increased In three of the four categories In both that group paired 
with high ATB and that paired with low ATB cooperating teachers. 
We might conclude, then, that the introduction of the Instrument 
appears to be associated with a general increase In active teaching 
behaviors while non-Introduction Is associated with a decrease In 
those behaviors. Such a conclusion is, however, confounded by two 
factors. First, a purported cause and effect relationship between 
the introduction of the Instrument and the Increase in active 
teaching behaviors is undermined by the fact that in two catego- 
ries. Instruction and closure, one group Increased while the other 
decreased. Secondly, follow-up Interviews of the student teachers 
who had been introduced to the ATB instrument demonstrated greatly 
varying degrees of introduction. That is, some student teachers 
were given the instrument to study, were provided with specific 
definitions of the behaviors, and were aware of being observed, 
while other student teachers were simply shown the instrument. 
Thus, it is not possible to claim a specific effect of introduction 
to the instrument when such introduction took varying forms with 
the different cooperating teachers. 

The results in these three research/intervention plans do not 
point to clear associations between the specific intervention and 
changes in active teaching behaviors by cooperating and/or student 
teachers. This lack of clarity, however^ should not be viewed as a 
function of deficiencies in the three research strategies. These 
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research projects were, In effect, exploratory studies, first-time 
attempts to bring local educational agencies and teacher education 
programs together to apply research findings in the training of 
student and cooperating teachers. 

As IS the case with many exploratory studies, the research 
plans Involved a small number of participants, utilized an untested 
observation instrument, and limited the number of observations. 
All of these factors contributed to results that are difficult both 
to analyze and to generalize. At the same time, however, as ex- 
ploratory studies, these projects set the stage for the Research 
Fellows and their colleagues in both the teacher education programs 
and the local school districts to carry out subsequent research 
projects, profiting from this initial experience. Moreover, 
participation in the research project had specific effects on the 
attitudes of student and cooperating teachers toward their class- 
room activities and tne power of research findings to inform these 
activities. In the following section, we will examine these chang- 
ing atti tudes. 

Reactions of Student and Cooperating Teachers 

A major purpose of the ARTE: RUETE project is to influence 
teacher attitudes about the value of the use of research in their 
classrooms. In this section we explore what participating student 
and cooperating teachers took away from their experience with the 
research/intervention projects. In all three sites, project staff 
used a semi -structured format to interview participating teachers 
after their involvement in the project had ended. Brief excerpts 
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from the Interview data are used In the following discussion. 

Interestingly, cooperating teachers In all three sites reacted 
In a similarly positive manner to their experience. At Utah, the 
Research Fellow interviewed three of the four cooperating teachers 
from treatment group A, those who had participated In both the 
collaborative session and the preservlce training. All three ot 
the cooperating teachers noted that their participation had forced 
them to re-evaluate their own teaching methods. One notea that the 
research on effective Instruction had "reinforced my teaching, 
strengthened my own beliefs." Another pointed out that while the 
experience had strengthened her beliefs about effective teaching. 
It had "also raised some questions about my practices In other 
areas." One of the teachers actually found her teaching Improving 
as she became more capable of "laying things out for my students." 
A final positive result was noted by a cooperating teacher who 
said, "Examining research findings provided me with a more global 
view of the world of education." Importantly, the one cooperating 
teacher who was not available for Interviewing Is pursuing her work 
with the research on effective teaching by participating In the 
ongoing teacher education academy. 

The cooperating V5achers In the Mills project. Interviewed by 
the visiting scholar on that research team, pointed out that the 
experience had had a definite Impact on their teaching methods and 
the way they think about them. One notea, "It heightened my self- 
consciousness." The cooperating teachers also found that by the 
eno ot the experience they naa become much more comfortable being 
observed. The teachers noted that they also came to view student 
teachers In a new light, understanding how student teachers 
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naturally react to their cooperating teachers. 

The data from the Nevada Research Fellow's Interviews of the 
cooperating teachers shows similar reactions to participation in 
that project. One teacher said, "Since Tve been teaching tor 11 
years, sometimes i fall down on some of these things (active teach- 
ing behaviors) and it really brought some of those things home to 
me again." Another pointed out that "as an experienced teacher, I 
forget some of the basic behaviors which are important. It was a 
good experience to be reminded." 

It is difficult to compare the cooperating teachers* responses 
across the three sites. Thejnterview protocols were not the same. 
The Utah Fellow only Interviewed those teachers in treatment group 
A, while at the other two sites all teachers were interviewed. 
Still, the similarity in responses does point to a common outcome 
tor all cooperating teachers: a re-evaluation of their own teach- 
ing methods, a questioning of some of these, and a reinforcing of 
the appropriateness of others. Moreover, at the Kills site, the 
teachers seem to have come to understand their relationship with 
student teachers better. 

There appeared to be more variation among the three sites in 
student teacher response to participation in the project* in Utah, 
all three of the students agreed that the use of research in de- 
veloping their personal teaching strategies had given them con- 
fidence in their initial teaching assignments. They also noted 
that they believed it important to base teaching strategies in 
research findings. One stated, "Now, I have some specific ideas of 
things that are helpful in teaching, rather than just going by what 
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•feels* good." Two of the respondents also pointed out that they 
have continued to discuss the active teaching behavior research 
with faculty members, and have continued to use It In their sub- 
sequent teaching assignments. 

Two of the four student teachers at Mills also reported using 
the active teaching behaviors In their second semester teaching 
assignments. The student teachers found that their experience had 
changed their teaching methods, that they now state objectives more 
clearly, ask open questions more frequently, and pay more attention 
to what pupils are doing while they teach. These teachers at Mills 
also noted that they had been fairly skeptical about the potential 
effectiveness of the research findings when they took part In the 
three-day training session. It took them time and experience 
working with the concepts to become convinced of the value of the 
project. 

The student teachers at Nevada expressed some of the same 
positive responses. One noted, "It was good to see something like 
this {the ATB Instrument) and to remind yourself of what things you 
need to do." Another said, "It was a very good review for me." 
Yet, the Nevada student teachers also expressed a certain amount cf 
disappointment In the way they were Introduced to active teaching 
behaviors. Une student teacher pointed out that she "wished It 
hadn't been so secretive." Another, lamenting the cursory nature 
of the intervention, said, "1 wished I had the opportunity to learn 
about It, maybe my cooperating teacher could have used It with me 
more . " 

The variation among the responses of the student teachers at 
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the three sites. Mills, Utah, and Neva^^ia, be explained by the 
relative extensi veness of the three research/intervention plans. 
At Utah, the student teachers took part in a three-day planning 
session and a four-day preservice training. At Mills, the student 
teachers participated in a three-day preservice training. It is 
not surprising then that the student teachers at Mills noted that 
they had been skeptical of the value of the research plan after 
their initial training. The Utah student teachers expressed no 
such skepticism, as they had been a part of the group which had 
developed the research plan at that Institution. The fJevada 
stuaent teachers* desire for .a clearer and more comprehensive 
unaerstanding of the research on active teaching behaviors is a 
function of the limited scope of the Nevada intervention. Here 
there was no structured training introducing the research, nor was 
there any structured foi low-up. It appears then that with student 
teachers, the long-term effects of the research strategies depend 
on the extensi veness of the training and of their participation in 
its planning. 
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CHAPTER FIVE 

OUTCOMES FOR TEACHER EDUCATION PROGRAMS ANU 
THEIK CONTINUED USE UF RESEARCH 

A major goal of the Far West Laboratory's collaborative inter- 
vention has been to bring about changes In the ways teacher educa- 
tion programs and local educational agencies work together to train 
preservlce and certificated teachers. A main tenet of the research/ 
intervention projects was that the process by which teachers are 
trained is a function of entrenched organizational characteristics, 
not of Individual personalities. In this chapter, we focus on those 
changes at the three research/Intervention sites that may facilitate 
the continued application of research findings in the inservlce and 
preservlce education or teachers. 

The process of training teachers Is extremely complex. The 
preparation of a single teacher Involves numerous organizational 
structures, the institution of higher education, the local co- 
operating school district, a particular school, and a specific 
classroom. It is the interaction among these different organiza- 
tions and the individuals who work within them that constitutes the 
teacher education process. A discussion of the changes in this 
complex interactive process helps to define the effect of the Far 
West intervention on the three sites. 
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Nevada 

Of the three teacher education programs, Nevada's underwent 
the most visible structural changes. Prior to the Far West Lab- 
oratory intervention, the interaction among the various organiza- 
tions ana personalities was not formally coordinated. The Nevada 
Fellow functioned in isolation from his faculty colleagues in his 
placement of student teachers in local schools. For political 
reasons, different schools and a different group of cooperating 
teachers were used each year. Moreover, the local school district 
conducted its own inservice training program without cooperative 
planning with the university's faculty. 

The teacher education process in Nevada is markeoly different 
today. The Nevadc. Research Fellow ana four of his colleagues from 
the teacher educition faculty are presently working with local 
school district staff to develop a program similar to Utah's Pro- 
fessional Development Centers. Ten student teachers will be paired 
with 10 cooperating teachers in this single school in the Fall 1984 
semester. The program Is being arranged with the cooperation of 
the builaing principal. The faculty will be responsible for super- 
vising the student teachers and for providing inservice instruction 
for the school's classroom teachers. Other schools in the local 
district have expressed interest in developing the Professional 
Development Centers concept in cooperation with the Nevada teacher 
education program. 

As Far West Laboratory prepares to discontinue its direct work 
with the University of Nevada, Reno, and the Washoe County Unified 
School District, the interaction among these organizations and the 
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Individuals within them is now rr.arked by additional cooperative 
efforts toward the improvement of the teacher education process. 
Five university faculty are working together in one sett^^^ig. A 
cadre of cooperating teachers has been invitea to collaborate with 
the teacher education program to ensure that student teachers are 
repeatedly placed with experienced professionals. A sufficiently 
large group of student teachers are being placed in one school to 
allow them to work together, videotaping one anothers* classes and 
providing one another support. Moreover, the school district and 
the teacher education faculty are cooperatively planning inservice 
training of district teachers. In many ways, then, the teacher 
education process in the Nevada site is structured in such a way as 
to facilitate the introduction of research findings. Faculty, 
student teachers, cooperating teachers, district personnel, and 
school -level principals are working together to improve the process 
of training teachers. 

Mills 

At Mills, the small faculty was already cooperating in their 
programmatic efforts, the teacher education program had established 
a cadre of experienced cooperating teachers in specific schools, 
and the faculty worked closely with the staff development officer 
in the local school district. On the basis of this close interac- 
tion among the various organizations and individuals central to the 
teacher education process, the Research Fellow and his colleagues 
have been able to initiate a number of projects building on their 
experiences with the research/intervention project. 
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Right after the conclusion of the research project on active 
teaching behaviors and academic learning time In the Fall of 1983, 
the faculty at Mills decided to Implement a second phase In the 
spring semester. Given their experience with the first phase of 
the project, the same cooperating teachers were Invited to join In 
the collaborative planning of the second research/Intervention 
plan. Again, the focus of the project was to Improve the use of 
active teacning behaviors and academic learning time. 

At the same time, the Mills Research Fellow and a visiting 
scholar at Mills adapted the research/intervention strategy, which 
had been used In the teaching of elementary math classes, to 
science classes. The results of this research project have been 
reported elsewhere (Russell, 1984). 

These two additional research projects demonstrate that the 
application of research to the teacher education program Is begin- 
ning to be Institutionalized at Mills. The faculty has taken the 
systematic methodology which It learned through participation In 
the Far West Laboratory project and has begun to apply It to a 
number of relevant situations. The Mills Research Fellow Intends 
to repeat the research/Intervention project with t>.e Fall 1984 
student teaching group. 

Mills has also begun to extend Its efforts to work In coopera- 
tion with a number of other Institutions of higher education In the 
northern California area as a part of Its teacher education academy 
plans. Unlike the University of Utah and the University of Nevada, 
Mills Is surrounded by numerous universities and colleges with 
teacher education programs. Many of these Institutions place 
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student teachers and/or graduates in the same school districts. An 
Improvement of the overall process of training teachers In the 
area, then, requires a certain amount of cooperation among the many 
teacher education programs* Mills has spearheaded an effort to 
bring approximately 15 separate Institutions together to discuss 
ways of effectively cooperating with one another as well uZ with 
local school districts. This joint venture Is being funded by a 
private foundation* 

The process changes at Mills, then, are quite different than 
those In Nevada. Mills had already established many of the 
structures which are now bevng put in place In Nevada. The 
existence of the structures, a strong cooperative relationship 
among and between faculty and the local school district, allowed 
the Mills faculty to move quickly to implement a number of other 
research projects based on its experience with the Far West 
Laboratory program. At the same time. Mills location in populous 
northern California provided the teacher education faculty with the 
opportunity to work with faculty from a number of other institu- 
tions. While these changes do not represent a fundamental shift in 
the process by which teachers are educated at Mills, they do point 
to an Increase in the systematic application of research to the 
program. Moreover, Mills cooperation with 15 or so other teacher 
education programs may lead to significant changes in the way local 
communities and universities interact to meet the labor market 
demands of elementary and secondary schools in northern California. 
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Utah 

Prior to the Far West Intervention, the teacher education 
process In Utah enjoyed the most structured cooperation among the 
teacher education program, the local school districts, and the co- 
operating schools. Utah had Professional Development Centers 
(PDCs) established in schools throughout its cooperating school 
districts. All student teachers were placed in one ot these 
centers for their student teacher e;^per1ence. The same cadre of 
cooperating teachers and the same school administrators worked with 
each cohort of new student teachers. Moreover, university faculty 
assisted in the inservice training of teachers in the PDCs. In 
short, the complex interactive process which defines how student 
teachers are trained was structured to a greater extent in Utah 
than in either of our other two sites. This structure was marked 
by a high degree of cooperation among the teacher education pro- 
gram, the school districts, and the schools which served as sites 
for the PDCs. 

Given this structure, the Utah faculty has taken the research 
strategy which they used in one professional development center ana 
extended it to not only all of the PDCs but to school districts 
statewide as part of the teacher education academy plans. They 
have used the established structures to expand their efforts to 
systematically apply the research on effective teaching in their 
teacher education program. For example, Utah is including a rural 
district in the southeastern region of the state with which the 
institution has not worked before in its research plan for 
September, 1984. 
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Utah's cooperation In the Far West project, however, has led 
to different changes In the teacher education process than occurred 
in Nevada and Mills. In both Nevada and Mills, the changes were 
toward recognition of the complexity of the Interactive teacher 
education process. Nevada has brought school district personnel, 
school-level administrators, cooperating teachers, and teacher 
education faculty into a structured process. Mills has begun to 
cooperate with a number of other institutions of higher education 
to coordinate their leacher education efforts. Such efforts have 
not been necessary at Utah. The University of Utah, Salt Lake 
City, is the largest and one of only a small number of teacher 
education programs in northern Utah. Moreover its program already 
has structured its interaction with local cooperating school dis- 
tricts. Thus the changes in the Utah program have been quantita- 
tive ones as it works to expand its efforts to more and more 
districts and schools. 
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CHAPTER SIX 
CONCLUSION 

This report offers a cross-site analysis of three research/ 
Intervention projects (R/IPs) that were carried out as part of a 
larger study of applying research In teacher education. The report 
describes the development and implementation of the three projects 
at sites In Utah, California, and Nevada and examines outcomes of 
the projects with regard to changing teaching behaviors and con- 
tinuing use of research In teacher education. 

Development and Implementation of the Projects 

The overall Intervention strategy for the three Intervention 
projects was conceived, developed, and Implemented by Far West 
Laboratory for Educational Research and Development. The primary 
result of the Intervention strategy was that faculty In three 
teacher training programs began to apply systematically In their 
preservlce programs the existing research on effective teaching 
stra tegles. 

The specific nature of the development and Implementation of a 
strategy for each site, however, was tied to the Far West Lab- 
oratory's collaborative Intervention approach. In this case. Far 
West Laboratory worked with three teacher education faculty members 
(the Research Fellows) from three Institutions of higher education 
and their respective cooperating school districts. This was an 
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attempt to bring the research on effective instruction to bear on 
each organization. The three different research/intervention pro- 
jects, therefore, were functions of the differing characteristics 
of the various sites. 

In Nevada^ the research/intervention plan was developed partly 
in response to the plans for the other two sites. Both the Utah 
and Mills Research Fellows developed elaborate plans for introduc- 
ing student teachers to the relevant research which Included the 
participation of other teaching faculty, student teachers, and 
cooperating teachers. Exposed to these planning models, the Nevada 
Research Fellow decidea to use a much less elaborate method of 
introducing the research. His purpose was to examine the relative 
efficacy of expending significant efforts on applying research to 
teacher education programs. 

At Mills College in California, where the faculty was 
accustomed to using the research from the child development litera- 
ture in its teacher training program, the Research Fellow noted 
that the intensity of the collaborative process led to a much more 
systematic application of the research in his particular R/IP than 
he or his colleagues had experienced previously. 

At the Utah site, the Research Fellow pointed out that the 
extensive collaborative nature of her research/intervention plan, 
wherein the project was developed and implemented by a team of 
teacher education faculty, cooperating teachers, and student teach- 
ers, was a direct result of the collaborative process she had 
experienced. 

In Figure 3 of Chapter Three we indicated the interaction 
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among the characteristics of the three sites that affected the 
development and Implementation of the research/ Intervention pro- 
jects* Specific aspects of the structure of the teacher education 
program. Its size, the traditional collaboration among faculty 
members, and the existence of latitude in the program for the 
interjection of an innovative project, combined to affect the 
research strategy. Similarly, the commitment of the local educa- 
tional agency to the ongoing training of teachers affected the 
various research plans. Yet, in all three sites, the traditional 
relationship between the teacher eaucation program and the coopera- 
ting school district played the most Important role in affecting 
the varying outcomes. This relationship was, naturally. Itself a 
function of the characteristics of the teacher education program 
and the cooperating school districts. Finally, the three Research 
Fellows themselves played a pivotal role in defining the different 
plans. Our analysis of the variation among the three research 
strategies leaas us to conclude, however, that inaividual dif- 
ferences were of secondary Importance in relation to the structural 
characteristics. 

Outcomes 

While the short term goal of the collaborative process of 
research intervention was the application of research where it had 
not been used extensively before, the long term goal was the de- 
velopment of professionals who would continue to utilize research 
skills and findings in their work beyond the specific project at 
hand. The overall intervention strategy called for this secona 
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goal to be achieved through the formation of Teacher Education 
Academies that would continue even after Far West Laboratory was no 
longer directly Involved In the projects. Through Interviews with 
the Research Fellows and examination of their activities outside of 
the Far West Laboratory project, we have found ample evidence that 
this secondary goal Is being realized. 

Prior to his participation in this project, the Research 
Fellow in Nevada felt that he was isolated from his peers. In 
fact, there was little structured support for collegial interaction 
and support among faculty members in his department. As a result 
of his intensive efforts to apply research in the teacher education 
program and the visible suppqrt he received in doing so from both 
Far West Laboratory and the Research Fellows, he reported, "I am no 
longer an island in my institution. Now there is dialogue among 
the faculty members." The Nevada Research Fellow has begun to use 
some of the techniques from the effective teaching literature in 
his own teaching. Moreover, he is planning further research pro- 
jects with a number of the other faculty members who are interested 
in applying the research on teacher effectiveness in their courses. 
As a result of his participation in this project, the Nevada Re- 
search Fellow expanded his leadership role in his department. He 
is now spearheading an attempt to establish a Teacher Education 
Academy at a local elementary school in which four or five teacher 
education faculty members, 10 student teachers, and various school 
personnel will work in a formalized, collaborative endeavor. 

At Mills, the results of the Far West Laboratory intervention 
are perhaps even more tangible. Here the Research Fellow found 
himself in an environment where there was already a great deal of 
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mutual support and interaction among faculty members. Working from 
this supportive base, the Research fellow, in collaboration with a 
department colleague and a visiting scholar, developed two research/ 
intervention plans in addition to the one he had established in his 
work with the Far West Laboratory Regional Teacher Education Team, 
In one study, three faculty members examined the transferability of 
the research on academic learning time and active teaching behaviors 
which the Research Fellow had used in his Far West Laboratory R/IP to 
the teach ng of high school science. In the second study, the Re- 
search Fellow and his colleagues at Mills plan to use the same re- 
search strategy he had devel-oped as part of his work at Far West 
Laboratory in a second school district that was not part of the Far 
West Laboratory study. Again, we see the effects of the intensive 
collaborative mode of intervention used by Far West Laboratory on the 
professional activities of a researcher beyond the limits of the 
intervention itself. Of considerable interest is the Mills effort 
that brought approximately lb separate teacher education programs and 
their cooperating school districts together to explore collaborative 
and innovative research applications. This effort has been supportea 
by private foundation funding. 

At the Utah site, too, the Research Fellow has oegun to in- 
corporate active teaching behaviors into her own teaching. 
Furthermore, the Research Fellow intends to incorporate the re- 
search on active teaching behaviors into the "early experience" 
portion of the school's preservice training, an optional yet 
formally structured orientation period of two weeks in the fall of 
each year. She will also train the cooperating teachers who super- 
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vise student teacntrc on how to observe active teaching behaviors. 
In short, she Is incorporating the research findings from her study 
with Far Wesc Lai oratory into the institution's regular teacher 
training and inservice training. In addition, she is discussing 
the possibility of using the collaborative model with a number of 
fellow faculty to examine the research on teacher educators* super- 
vision of student teachers in order to strengthen their activities 
in this area. Finally, the research strategy Is being extended not 
only to all of the PDCs but also to school districts throughout the 
state. This Is most promising for the continued use and application 
of recent research findings. 

Summary 

There were no r.lear results regarding change in classroom 
teaching behavior. However, the perspectives of student and coop- 
erating teachers toward the value of research became Increasingly 
positive across all three sites. Achievement of the project gcal 
of a continuing and exparding network among teacher education 
programs and local education agencies seems promising at this time. 

Our analysis of the three research/intervention projects reaf- 
firmed the belief that the process by which teachers are educated 
is a complex, interactive one involving numerous organizations and 
individuals. Teacher education programs, their faculty, school 
districts and their staff development officers, schools and their 
principals, classrooms and their teachers all interact to define 
the education of a single scudent teacher. Change in such a com- 
plex interactive process can never De linear; that is, an outside 
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agency cannot simply cause specific changes to occur. Rather 
csiange Is a joint product ot outside factors and specific situa- 
tional characteristics* Attempts to effect change In the prepara- 
tion of teachers must begin with an understanding of the Influence 
of contextual factors. The variation among the three research/ 
Intervention projects Is evidence of the validity of this conten- 
tion. 
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ARTE: RUETE 
Active Teaching Behaviors (ATB) 



The observation system described here is designed to reflect 
behaviorial evidence of active teaching behaviors during direct in- 
struction in the classroom. It provides a common language for dis- 
cussion and serves as an indicator of the presence of some charac- 
teristics of effective instruction. 

The active teaching constructs structure the collection of as 
much instructional information as possible. The observer focuses 
on the teacher and what s/he is doing. Observers will record in- 
formation about instruction for the duration of one complete lesson 
period including sequence, frequency, and field note descriptions. 
This calls for continuous monitoring of the teacher during instruc- 
tion in a basic skills lesson. The observation form presents a 
minute by minute account of how instruction is conducted. Behaviors 
should be recorded specifically and in as much detail as possible. 

The following sections identify the categories and variables 
of instructional behaviors you will be observing and describing, 
discuss the observation sheet on which you will record information, 
and presents the procedures for accurate and complete reporting. 



ATB Observation Categories and Variables 



The categories and variables reflect recent research on effec- 
tive instruction and focus upon the elements of instruction. There- 
fore, observers focus on teacher behavior related to delivering in- 
struction. Potentially there are many things about instruction in 
which one could be interested, however, for purposes of reflecting 
the active teaching constructs observers focus only on the teacher's 
behavior and how students respond to this. Essentially, we are in- 
terested in four categories: 

1. How the teacher introduces instruction. 

2. How the teacher carries out instruction. 

3. How the teacher maintainr Ttudent engagement. 

4. How the teacher cond udes instruction. 

These four categories are thought of as the core of instruction 
and represent events which occur in the stream of instruction as a 
teacher prerents lessons to students. Generally, the four elements 
occur in a cycle: a teacher introduces the lesson, presents new in- 
formation, establishes and maintains students in the activity, and 
summarizes the instruction presented. During Instruction a teacher 
cycles back through these four categories and switches among them. 
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The task of the observer is to describe precisely and objectively 
how the teacher does these things* Naturally, each teacher does any 
of these things in different ways* In fact, teachers use many dif- 
ferent strategies to accomplish any one of these things. It is not 
possible to list the many ways in which each of these four categories 
of instruction might be expected to look during observations. How- 
ever, based on previous research we can speculate about the various 
ways in which each of these four categories might be manifested. 
These are provided in the discussion which follows. 



Introduction 

!• S tated goals/objectives : Teacher opens with a statement 
of the purpose of the lesson; what the student is to 
learn. The intent is to focus the lesson, alert the stu- 
dent to intended objectives, and to what s/he is to pro- 
duce. Example: "Today we wil 1 study prefixes, which 
wil 1 help you to read hard words better and faster. " 

2. Outlined lesson : Teacher informs student of how the 

lesson will proceed, activities to follow, tasks to be 
compl eted, and sets time 1 imi ts. Iixampl e : "Fi rst I 
will tell you about wolves, then you will write a story 
about then. We will finish by 11 o'clock." 

3. Explained concepts/definitions : Teacher Introduces the 

definitions in advance, or in context; may provide hand- 
outs, use visuals, etc.; teacher states the concept in a 
clear statement in order to highlight for student aware- 
ness. Example: "Deciduous trees, like maple and apple 
trees, lose their leaves in the winter." 

4. Reviewed goals/previous instruction : Teacher connects 

today's lesson with previous lesson by tying the two 
together with a statement such as, "Yesterday we went on 
a field trip to a farm and today we will study animals 
that 1 ive on a farm." 



Instruction 

5. Gave directions : Teacher provides directions for activi- 

ties. Example: "First you will underline each vowel in 
the word, and then you will write a sentence using the 
whole word." 

6. Didactic/lecture : Teacher makes direct, straightforward 

presentation of material through lecture, film, etc. 
Basically this is a one-way communication. 
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7* Illustrated, modeled, demonstrated ; Teacher gives a verbal 
illustration of an instance that exemplifies the concept of 
focus, provides a graphic arts illustration, uses the chalk 
board to illustrate a point, visually demonstrates using me 
dia or provides behavioral enactment of the OvSired action* 

8* Questioned: Open/concepts/understanding ; Teacher asks 
questions which are open-ended, relate to concepts being 
presented, and/or checks for student understanding of 
content. Example: "What would happen if we didn't capital 
ize some words?" 

9* Questioned: Closed/facts : Teacher asks closed questions 
of a factual nature; recall questions; moves lesson along 
with a quick checK. Example: "Now who can name the three 
causes of the Civil War?" 

10. Answered: Content/questions : Teacher responds to student 

questions related to the content being taught. Example: 
"Yes, dinosaur fossils could be found under the ocean." 

11. Answered: Procedural questions : Teacher responds to stu- 

dent questions about procedures, how to perform assigned 
tasks, etc. Example: *'No, first you should write the 
word and then cover your paper and spell it." 

12. Provided feedback : Teacher communicates to students if 

an<^wer/work/procedures are correct or incorrect. Example: 
"That's right. You remembered to indent til your margins." 



Closure 



13. Summarized lesson/wo rk: Teacher restates/provides over- 

view of material presented together with procedures and 
tasks accompl ished. Example: "Today we learned three 
things about tadpoles and wrote a poem about them." 

14. Co llected work : Teacher rer;uests students to turn in 

their work. Example: "Please pass your paper to the 
person on your left." 



Maintenance 

15. Restated class rules : Teacher reminds students of appro- 

priate behaviors/procedures by restating cl ass rules. 
Example: "Remember, we always use 'walking feet* in our 
classroom." 

16. Told to attend : Teacher reminds students to listen, to 

participate, to be "on task", or to attend to current in- 
structional activity. Example: "Mike, your eyes need 
to be on your own paper." 



ERLC 



83 91 



17» Roamed room : Teacher walks among students. Purpose may 
be to check work, management, etc* 

18. Signalled (non-verbal ) : Teacher gestures, stares, or 

otherwise indicates modification in student behavior > 
Example: Teacher puts finger to her lips for quiet. 

19. Scanned room : Teacher looks around the classroom to 

monitor engagement and/or "on task" behavior. 

20. Disciplined: Teacher intervenes regarding disruptive 

behavior on the part of a student. Example: Sending 
the student from room. 



ATB Observation Procedures 



The observation task is two fold: (1) categorizing the frequency 
of observed variables, and (2) describing instructional behaviors 
of the teacher. Both are completed on a minute by minute basis. 
These two tasks are de^';ribed in this section. 

Recording the frequency of instructional behaviors involves 
selecting one of 20 variables which best characterizes the teacher's 
behavior that occurred during the minute being coded. These 20 
variables are designed to be sufficiently flexible so that in- 
structional behavi ors can be assi gned to one of the variables. 

Once the variable has been selected and checked, the observer 
must write a description of the specific action or language which 
exemplifies the variable. 

Steps for completing the observation recording sheet are: 

1. Circle the appropriate site number as designated by your 
trainer. 

2. Enter the name of the teacher for "CLASS." 

3. Enter the sheet number for the lesson you are observing. 
Each complete lesson will begin a different series of 
sequential numbers. 

4. Enter the date [month/day /year] of the observation day. 
For October 14, 1983 enter "10/14/83." 

5. The actual recording of variables is In two parts: 

a . Beginning with the f1 rst minute of the ^esson, and 
continuing minute>bv>minute through the int:re lesson, 
place a checkmark in one appropriate variable column 
for the teacher behavior observed. For example, if 
during the fifth minute of the lesson you see the 
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teacher leave her desk and walk among the students' 
desks, then you would place a checkmark in row 5, 
column 17: Roamed room. 

Enter only one checkmark for each minute of observation. 
If you observe more than one variable in any given min- 
ute, place a check in the one variable column you feel 
reflects the behavior emphasized by the teacher. 

b. Immediately after you have placed a checkmark in one 
variable column which corresponds to the appropriate 
minute row, write a phrase describing the behavior of 
the teacher during that minute in the "Description" 
column. These descriptions will be brief. For the 
example above, if you observed the teacher roaming 
the room and s/he stopped at the desk of a child who 
was talking loudly to another student several seats 
away about the pencils and erasers in his pocket, you 
might write "Roami ng, stopped at desk ,chil d cal 1 ing 
out, put hand on child's shoulder, child attended to 
worksheet." 

If information is made available later in the lesson 
which sheds light on the context and purpose of the 
lesson, codes can be changed. 

6. After the entire lesson is finished, you must record two 
more observations. These last two recordings are based 
on your sense of the lesson as a whole, 

a. At the top of your first sheet (sheet # 1) in the 
information box, which appears on the left half of 
the sheet, and below the dotted line, place one check- 
mark. Below "MOMENTUM" a check is placed beside 
"YES" if you felt the teacher was able to sustain 
students * i nterest , moved the lesson forward at an 
appropriate pace, and accomplished stated lesson 
objectives. Place a checkmark by "NO" if you do not 
think momentum was sustained. 

b. One checkmark is placed by "YES" for "DIFFERENTIATED IN- 
STRUCTION'* if you feel the teacher paced, restructured, 
or re-taught the lesson to meet student needs. Place a 
checkmark by "NO" if you feel the teacher did not show 
this flexibility. 

7. Sum the checkmarks in each colun.n for each sheet. Enter 
the sum for each column, 1 through 20, in the row "TOTAL". 
If no checkmark appears, enter a zero (0) In the column. 
The total of sums, column 1 through 20, for each sheet 
should be no more than 7. 
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